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■ Abstract 

In this paper, the problem of fast point-to-point MIMO channel mutual information estimation is addressed, in 

the situation where the receiver undergoes unknown colored interference, whereas the channel with the transmitter 

is perfectly known. The considered scenario assumes that the estimation is based on a few channel use observations 

during a short sensing period. Using large dimensional random matrix theory, an estimator referred to as G-estimator 

I is derived. This estimator is proved to be consistent as the number of antennas and observations grow large and its 

' asymptotic performance is analyzed. In particular, the G-estimator satisfies a central limit theorem with asymptotic 

-4— > ' 

' Gaussian fluctuations. Simulations are provided which strongly support the theoretical results, even for small system 

dimensions. 



I. Introduction 



(N 
> 

in 

' The use of multiple-input-multiple-output (MIMO) technologies has the potential to achieve high data rates, 



since several independent channels between the transmitter and the receiver can be exploited. However, the proper 



\ evaluation of the achievable rate in the MIMO setting is fundamentally contingent to the knowledge of the transmit- 

O ■ 

receive channel as well as of the interference pattern. In recent communication schemes such as cognitive radios yj. 



it is fundamental for a receiver to be able to infer these achievable rates in a short sensing period, hence extremely 
fast. This aiticle is dedicated to the study of novel algorithms that partially fulfill this task without resorting to the 
(usually time consuming) evaluation of the covariance matrix of the interference. 

Conventional methods for the estimation of the mutual information in single antenna systems rely on the use of 
classical estimation techniques which assume a large number of observations. In general, consider 9 a parameter 
we wish to estimate, and M the number of independent and identically distributed (i.i.d.) observation vectors 
yi,''' tYm G C^. Assume is a function of the covariance matrix S = E [yiyj^] of the received random 
process, i.e. 9 = /(S), for some function /. From the strong law of large numbers, a consistent estimate of 
the covariance of the random process is simply given by the empirical covaiiance of Y = [yi,--- ,yAf], i.e. 
S = jgYY'^ = -Jj J2iLi yiy\^- The one-step estimator 9 of 9 would then consist in using the empirical covariance 
matrix S as a good approximation of S, thus yielding 9 = /(S) Q. Such methods provide good performance 
as long as the number of observations AI is very large compared to the vector size N, a situation not always 
encountered in wireless communications, especially in fast changing channel environments. 
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To address the scenario where the number of observations M is of the same order as the dimension N of 
each observation, new consistent estimation methods, sometimes called G-estimation methods (named after Girko's 
pioneering works El, lIU on General Statistical Analysis) have been developed, mainly based on large dimensional 
random matrix theory. In the context of wireless communications, works devoted to the estimation of eigenvalues and 
eigenspace projections |I5], Q have given rise to improved subspace estimation techniques Q, 111 - Recently, the use 
of these methods to better estimate system performance indexes in wireless communications has triggered the interest 
of many researchers. In particular, the estimation of the mutual information of MIMO systems under imperfect 
channel knowledge has been addressed in [9] and where methods based respectively on free probability 

theory and the Stieltjes transform were proposed. 

In this article, we consider a different situation where the receiver perfectly knows the channel with the transmitter 
but does not a priori know the experienced interference. Such a situation can be encountered in multi-cell scenarios, 
where interference stemming from neighboring cell users changes fast, which is a natural assumption in packet switch 
transmissions. Our target is to estimate the instantaneous or ergodic mutual information of the transmit-receive link, 
which serves here as an approximation of the achievable communication rate provided that no improved precoding 
is performed. An important usage of the mutual information estimation is found in the context of cognitive radios 
where multiple frequency bands are sensed for future transmissions. In this setting, the proposed estimator provides 
the expected rate performance (either instantaneous or ergodic) achievable in each frequency band, prior to actual 
transmission. The transmit-receive pair may then elect the frequency sub-bands most suitable for communication. 

The setting of the article assumes that the channel from the transmitter to the receiver is known by the receiver 
(but not known by the transmitter), which is a realistic scenario provided that some channel state feedback is 
delivered by the transmitter, and that the statistical inference on the mutual information is based on M successive 
observations of channel uses, where M is not large compared to the number of receive antennas N, therefore 
naturally calling for the G-estimation framework. The progression of this article will consist first in studying 
the conventional one-step estimator, hereafter called the standard empirical (SE) estimator, which corresponds to 
estimating the interference covariance matrix by the empirical covariance matrix and to replacing the estimate in 
the mutual information formula. We then show that this approach, although consistent in the large M regime, 
performs poorly in the regime where both M and N are of similar sizes. We then provide an alternative approach, 
based on the G-estimation scheme, and produce a novel G-estimator of the mutual information which we first prove 
consistent in the large Af, N regime and for which we derive the asymptotic second order performance through a 
central limit theorem. 

The remainder of the article is structured as follows. In Section |ll] the system model is described and the 
considered problem is mathematically formalized. In Section |llll first order results for both the SE-estimator and 
the G-estimator are provided. In Section |IV] the fluctuations of the G-estimator are studied. We then provide in 
Section |V] numerical simulations that support the accuracy of the derived results, before concluding the article in 
Section IVII Mathematical details are provided in the appendices. 
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Notations: In the following, boldface lower case symbols represent vectors, capital boldface characters denote 
matrices (I^v is the size-A^ identity matrix). If A is a given matrix, A'^ stands for its transconjugate; if A is square, 
tr(A), det(A) and || A|| respectively stand for the trace, the determinant and the spectral norm of A. We say that 
the variable X has a standard complex Gaussian distribution if X ~ U + iV {i^ = — 1) , where U, V are independent 
real random variables with Gaussian distribution K(0, 1/2). The complex conjugate of a scalar z will be denoted 

as D 

by z* . Almost sure convergence will be denoted by and convergence in distribution by — >. Notation will 
refer to Landau's notation: u„ = 0(t;„) if there exists a bounded sequence Kn such that u„ ~ K^Vn- For a square 
N X N Hermitian matrix A, we denote Ai(A) < . . . < Ajv(A) the ordered eigenvalues of A. 

II. System model and problem setting 

A. System model 

Consider a wireless communication channel Ht E C^x"o between a transmitter equipped with no antennas and 
a receiver equipped with N antennas, the latter being exposed to interfering signals. The objective of the receiver 
is to evaluate the mutual information of this Unk during a sensing period assuming Hf known at all time. For this, 
we assume a block-fading scenario and denote by T > 1 the number of channel coherence intervals (or time slots) 
allocated for sensing. In other words, we suppose that, within each channel coherence interval t G {1, . . . , T}, Ht 
is deterministic and constant. We also denote by M the number of channel uses employed for sensing during each 
time slot {M times the channel use duration is therefore less than the channel coherence time). The M concatenated 
signal vectors received in slot t are gathered in the matrix Yt E C^^*^ defined as 

Yt = HtXt,o + Wt 

where Xt o € C""^^ is the concatenated matrix of the transmitted signals and Wt G i^nxm j-gpresents the 
concatenated interference vectors. 

Since Wt is not necessarily a white noise matrix in the present scenario, we write Wf = GfWf where G* G 
(^Nxn jg gjj^jj j-jj^j. GtG^ e i^NxN jjjg deterministic matrix of the noise variance during slot t while Wt G (^y-xM 
is a matrix filled with independent entries with zero mean and unit variance. That is, we assume that the interference 
is stationary during the coherence time of Ht, which is a reasonable assumption in practical scenarios, as commented 
in Remark [T] The choice of using the additional system parameter n, not necessarily equal to N, is also motivated 
by practical appUcations where the sources of interference may be of different dimensionality than the number of 
receive antennas, as discussed in Remark [T] below. This will have no effect on the resulting mutual information 
estimators. 

We finally assume that perfect decoding of Xt o (possibly transmitted at low rate or not transmitted at all) is 
achieved during the sensing period. If so, since Ht is assumed perfectly known, the residual signal to which the 
receiver has access is given by 

Yt=Yt-HtXt^o = GtWt. 
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Fig. 1. System model of Remark [T] with two interferers. 



Remark 1: The usual white noise assumption naturally arises from the thermal noise created by the electronic 
components at the receiver radio front end as well as from the large number of exogenous sources of interference 
in the vicinity of the receiver However, in cellular networks, and particularly so in cell edge conditions, the main 
source of interference arises from coherent transmissions in adjacent cells. In this case, only a small number K of 
signal sources interfere in a colored manner Calling Gt.k G C^^"'' the channel from interferer k G {1, . . . , K}, 
equipped with Uk antennas, to the receiver and Xt ^ e (^n^xM concatenated transmit signals from interferer k, 
the received signal Yt can be modeled as 

K 

Yt = HtXt,o + ^ G(,fcXt,fe + aW; (1) 
fe=i 

where crWj G i£_nxm jj^g concatenated additional white Gaussian noise with variance cr^ > 0. In this case, we 
see that, denoting n = iii + . . . + tik + N and 



we fall back on the above model. Figure [T] depicts this scenario in the case of K ~2 interfering users. 

The statistical properties of the random variables Xj^q and Wt are precisely described as follows. 

Assumption Al.- For a given t where \ < t < T , the entries of the matrices Xt o and Wt are i.i.d. random 
variables with standard complex Gaussian distribution. 

The objective for the receiver is to evaluate the average (per-antenna) mutual information that can be achieved 
during the T slots. In particular, for T = 1, the expression is that of the instantaneous mutual information which 
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allows for an estimation of the rate performance of the current channel. If T is large instead, this provides an 
approximation of the long-term ergodic mutual information. Under Assumption lAll the average mutual information 
is given by 

1 ^ 

^ ^ ^5][logdet(H,HH + G^GH)-logdet(G*G,H)]. (2) 

t=\ 

The target of the article is to address the problem of estimating 3 based on T successive observations Yi , . . . , Yt 
assuming perfect knowledge of Hi, • • • , Ht, but unknown Gt for all t. 

B. The standard empirical estimator JgE 

If the number M of available observations during the sensing period in each slot is very large compared to the 
channel vector N, a natural estimator, hereafter referred to as the standard empirical (SE) estimator, consists in the 
following one-step estimator 



rp rp 

5sE = l^ElogdctfH.Hr + -;-Y.YH)-J-;^logdetfi-Y,Yr 



(4) 



NT ^'"^""^ \ ' ' ' M ' W NT \M - ' ' ■ 

t=i ^ ' t=i ^ 

For future use, it is convenient to introduce the notation 

hB{y) ^ ^T.'og det (y H.hH + ^Y. Y^) - ^T.'og det Y.Y^ 

t=i ^ / t=l V 

With this notation at hand, 3se = 3se(1)- 

For N fixed, it is an immediate application of the law of large numbers and of the continuous mapping theorem 
to observe that, as M — > oo, 

JsE - ? ^ 0. (5) 

However, from the discussions above, the assumption M ^ N may not be tenable for practical settings where 
sensing needs to be performed fast, particularly so under fast fading conditions. In this case, as will be shown 
in Section |III1 the SE-estimator is asymptotically biased in the large M, N regime, hence not consistent, and (|5]l 
will no longer hold true. This motivates the study of an alternative consistent estimator based on the G-estimation 
framework. To this end, we first need to study in depth the statistical properties of the SE-estimator from which the 
G-estimator will naturally arise. The statistical properties of the latter will similarly be obtained by first studying 
the second order statistics of the SE-estimator (themselves being of limited practical interest). Before moving to 
our main results, we first need some further technical hypotheses. 

C. The asymptotic regime 

In this section, we formalize the conditions under which the large A/, N regime is considered. We will require 
the following assumptions. 
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Assumption A2; M, N, n, tiq -> +00, and 

. . N . N 

< liminf — < linisup — < +00 , 

, M , M 

1 < liminf — < limsup — < +00 , 

< liminf — < limsup — < +00 . 

Af,no-i-oo N N.no^oo N 

Remark 2: The constraints over N and n simply state that these quantities remain of the same order The lower 
bound for the ratio M/N accounts for the fact that that M is larger than N, although of the same order 
In the remainder of the article, we may refer to Assumption IA2I as the convergence mode M, N,n —i' 00. 

We also need the channel matrices to be bounded in spectral norm, as M, N,n 00, as follows. 

Assumption A3; Let N = N{n) a sequence of integers indexed by n. For each t E {!, - ■ ■ ,T}, consider the 
family of iV x n matrices Gt. Then, 

• The spectral norms of Gt are uniformly bounded in the sense that 

sup sup ||Gt|| < 00 . 

l<t<T N,n 

• For t G {1, • • • ,T}, the smallest eigenvalue of GtG^ denoted by AAr(GfGj^) is uniformily bounded away 
from zero, i.e. there exists > such that 

inf inf AjvfGfG") > > . 

l<t<T N,n 

Assumption A4.- Let N = N{nQ) a sequence of integers indexed by uq. For each t E {1, • • • , T}, consider the 
family of iV x no matrices H(. Then, The spectral norms of Hj are uniformly bounded in the sense that 

sup sup ||Ht|| < 00 . 

l<t<T N,no 

Assumption AS.- The family of matrices (Hj) satisfies additionally the following assumptions: 

1) Denote by pt the rank of Ht. Then 

< liminf ^ < limsup ^ < 1 . 

N,no^oo N N,no^oo N 

2) The smallest non-zero eigenvalue of HtH^ is uniformly bounded away from zero, i.e. there exists k > such 
that: 

inf inf {A,(HtHt^) I \^(lItH^) > 0| > k > 0. 

III. Convergence of the average mutual information estimators 

In this section, we study the asymptotic behavior of the SE-estimator 3se and prove that under the asymptotic 
regime IA2i this estimator is asymptotically biased. Relying on this first analysis, we then derive a consistent 
estimator based on the random matrix inference techniques known as G-estimation. 

These techniques can be classified in two categories. One is based on the link between the Stieltjes transform 
(see Appendix |A|l and the Cauchy complex integral, recently exhibited by Mestre who developed a framework 
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for the estimation of eigenvalues and eigenspace projections ||5]. This approach is often well-adapted as long as 
the estimation of parameters depending either on the eigenvalues or on the eigenvector projections of Y^Yj^ is 
considered (see for instance Lemma [T) but may fail when the dependence is more involved. The second approach, 
which we will adopt here, is based on the technique of deterministic equivalents developed in ifTTl . lfT2l . It follows 
from the initial work ifTOl of Vallet and Loubaton, and will be illustrated in Section IIII-BI 

A. The standard empirical estimator JgE 

We start by studying the second of the two terms in the difference (|2|i for which it is much easier to derive an 
estimate. 

Lemma 1: Let Assumptions IAHlA4l hold. Then, we have the following convergence. 

Proof: See Appendix lAl ■ 

Remark 3: It should be noted that in the proof of lemma [T] the Gaussianity assumption of the entries is not 
necessary and can be replaced by a finite moment condition. 

Remark 4: Lemma [T] relies on the Stieltjes transform estimation technique from Mestre. The latter is used to 
compute a consistent estimate of the quantity log det(GiG^), which is seen here as a functional of 

the (non-observable) eigenvalues of GtG\^. Following the work from Mestre (|5], the idea is to link the Stieltjes 
transform of GjG^ to that of the (almost sure) limiting Stieltjes transform of the (observable) sample covariance 
matrix -j^YtYj^. See lfT3]| for a tutorial on these notions. 

As a consequence of Lemma[Tl we see that the logdet( -jgYtYf^) is a consistent estimate of logdet(GtG^) 
(recall that -jgEYfYf^ ~ GtG^) up to a bias term depending on the time and space dimensions only. This may 
suggest that, up to the introduction of the term HfHj^ in the log determinants for estimating the first term in (|2), 
the SE-estimator is also a consistent estimator for J. This is however not true. To study the first term in (|2), which 
is not as immediate as the second term, we need some further work. We start with a first technical lemma which 
follows instead from random matrix operations on deterministic equivalents. Q 

Lemma 2: Let Assumptions IAHjA4l hold and let y > 0. Then we have the following identities. 

1) The fixed-point equation in y 

M») = i^t,(G,G?(^ + .H,Hr)"') (6) 
admits a unique positive solution Kt{y). 

'By deterministic equivalents, we mean deterministic quantities wliicli are asymptotically close to the quantity under investigation. The 
advantage of considering such equivalents comes from the fact that this prevents from studying the true limit of the quantities under investigation 
(which might not exist anyway). See [11] for more details. 
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Denote by Tt{y) and Qt{y) the following quantities: 

- (^^*^* + ttS) ) " ' - G^*"* ^ ^ " 

2) Then, for any deterministic family (Sjv) of x iV complex matrices with uniformly bounded spectral norm, 
we have: 

i- tr SNQtiy) - -J7 tr SjvTt(y) > 0. 

IvI M M,N,n^oa 

3) Let 

V.iy) = logdet (,H.Hr + + Mlog(l + - M^^. 

Then, the following convergence holds 



^logdet fyH^Hj^ + ^Y^yA - ^-Vtiy) 



-> 



iV " V M / iV M,N,n^oc 

Proof: See Appendix iBl ■ 
Clearly, when setting y = 1, this result provides a convergence result for the SE-estimator, as will be stated 
in Theorem [T] Lemma |2] is however more generic in its replacing the term 1 in front of HjH^ by an auxiliary 
parameter y. As a matter of fact, the introduction of y is at the core of the novel estimator derived later We can 
indeed already anticipate the remainder of the derivations: if {1 + Kt{y))^^ can be made equal to y, then the first 
term in the expression of Vt{y) is proportional to the first term in (|2) which we are interested in. Turning the 
factor 1 into a generic variable y will therefore provide the flexibility missing to estimate ^ precisely in the large 
M, N, n regime. Before getting into these considerations, let us start with the following result on the SE-estimator. 
Theorem 1 (Asymptotic bias of the SE-estimator): Let Assumptions IA1HA4I hold, and denote 

^(y) = ]4 E (l°gdot (,H,H^ + ^1^) - logdet(G.Gr)^ 



,^ , M Kt(y) \ M~N^ /M-N\ ^ 



t=i 

where Kt{y) is the unique solution of Then, 



(7) 



jsE-v(i) — — ^0 



Proof: Gathering item 3) of Lemma |2] together with Lemma [T] yields the desired result. ■ 
This result suggests that the SE-estimator is not necessarily a consistent estimator of the mutual information, as 
there is no reason for the bias term in (|7) (for y = 1) to be identically null. However, based on the discussion prior 
to Theorem [U we are now in position to derive a novel consistent estimator The following section is dedicated to 
this task. 
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B. A G-estimator of the average mutual information 

The following result is our main contribution, which provides the novel consistent estimator for (|2). 

Theorem 2 (G-estimator for the average mutual information): Assume that IAHlA4l hold and define the quantity 

= E log det {in + y^,tHtH^ {j^^^^"^) ) 



1 ^ 



(M - iV) 



log 



M 



M -N 



VN.t 



M 

'n 



yN,t 



where yN,t is the unique real positive solution of 



VN.t 



VN.t 

M 



M 



M -N 
M 



Then 







Proof: We hereafter provide an outline of the proof, which is developed in full detail in Appendix |C] Denote 
Jt the average mutual information at time t as 

Jt " ^logdet(GiG,^^+H,H,^^)-^logdet(GtG,^) , 

Recall that a consistent estimate 3t,2 of 3t,2 was provided in Lemma [U It therefore remains to build a consistent 
estimate for 3t i. 

The proof is divided into four steps, as follows. 

1) In the first step, we exploit the convergence of parametrized quantities of interest. Denote 



/(y) = 1 logdet (^Y,Yr + yHtH^) 



and recall the definition of Kt{y) as given in Lemma |2l-l). By Lemma |2l-3), 

^fiy) + ^ logdet (-^^ + ,h,hh) + 1 iog(i + nM) " ^TT^ -Jif^ • 

A* \1 + Kt(y) J N N 1 + Kt{y) MM.n^oo 

Clearly, for most values of y; the deterministic quantity to which f{y) converges differs from 3t,i- 
2) In the second step, we find a specific value of y to enforce the desired quantity 3t,i to appear. One can readily 
check that if yN,t is the solution of the equation in y 

1 + Kt(y) 



then we immediately obtain 

..\ M - N M 1 

^ . (9) 



Jt,i 



4 logdet f ^Y.Y^ + yN.tUtU^] + ^^^—^ log(y^,t) + ^(1 - yN,t) 



M,Ar,n->oo 
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From the definition of Kt{y), we show that there exists a unique positive ?/jv j solution of ([8]l, given by the 
closed-form expression 

yN^t = l-^tT[{GtG^){iItH^ + GtG'^)-'] . (10) 

However, the value of yN,t still depends upon the unknown matrix to this point. 
3) In the third step, we provide a consistent estimator yjv^f of yN,t- Based on an analysis of Kt{y), and on finding 
a consistent estimate for this quantity, we show that there exists a unique positive solution yjv j to 

mt = ^ trm,t HtH," (m,t HtH," + j^YtY^) + ^^Jf^- (11) 



Moreover, yM,t satisfies 



yN,t - yN,t -j-TTT^ — > 



4) Finally, it remains to check that we can replace yN.t by ijN.t in the convergence (HJl. This immediately yields 
a consistent estimate Jt,i for 3t.i- For the proof of the theorem to be complete, it remains to gather the 
estimates of 3t^i and Jf 2, which finally yields the announced result 



1 ^ 
t=i 



IV. Fluctuations of the G-estimator 

In this section, we establish a central limit theorem for the improved G-estimator Oq, so to evaluate the asymptotic 
performance of our novel estimator Due to the Gaussian assumption on Wt, we can use the powerful Gaussian 
methods developed for the study of large random matrices by Pastur et al. llT4ll . lfT2l . In order to derive the asymptotic 
fluctuations of the G-estimator 3g, similar to the previous section, a first step consists in evaluating the fluctuations 

of JsE(y)- 

Theorem 3: Let Assumptions lAlllASl hold and recall the definition (|4|i of Jse(|/)- We then have the following 
results. 



1) The sequence of real numbers 
21og(Af) 1 ^ 



t=l 

is well-defined and 



(M - N) [ M{Kt{y) + ir tr ( -jr^T^ + J/H.Hr (0,0^ ' 



< liminf aN{y) < limsup a^iy) < +00 . 

J\/,JV,n-!-oo M.N.n^oo 



2) The following convergence holds 

N 



\/(^N{y) 

where V(y) is defined in (|7]i. 
Proof: See Appendix iDl 



\ J N,M,n^oo 
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With the above result at hand, we are now in position to derive the fluctuations of the G-estimator As opposed 
to 3se(2/) though, the G-estimator has no closed-form expression, as the jjN.t's are solutions of implicit equations. 
Establishing a CLT for therefore requires to control both the fluctuations of the received matrix Yt and of the 
quantity yN,t- In the following lemma, we first prove that the fluctuations of yjv.t — ?/jv.t are of order 0{AI^^), 
a rate which will turn out to be sufficiently fast to discard the randomness stemming from i/jv,t in the asymptotic 
fluctuations of 3q. 

Lemma 3: For t E {!,■■■ , T}, the following estimates hold true, as M, N,n oo: 

1) yaiim^t) = 0{M-^) , 

2) EyN,t = yN,t + 0{M-^) . 

Proof: See Appendix |E] ■ 
We are now in position to state the central limit theorem for 3q. 
Theorem 4: Let Assumptions lAlllASl hold true. Then, 



N- 



where 9n given by 



On = ^ Y,2\og{MyN,t) - log [{M - N) (a/ - tr {In + HtH,^(G«G,^)-i] 



(12) 



which is a well-defined quantity which satisfies 



< liminf 0n 

M,7V,Tt— >-oo 



< limsup 6n < +00 

AI,N,n~¥oo 



Proof: Consider the function dt{y) defined for y > as: 

M -N 



TV 



log 



M 



M-N 



1 



- ^2/ - log det 



M 



Then 3q = ^ X]t=i 3t{yN,t)- Since all the random variables {dt{yN,t)i 1 < t < T) aie independent, it is sufficient 
to prove a CLT for 3t{yN,t), for a given t e {1, • • • ,T}. In order to handle the randomness of y^.t, we shall 
perform a Taylor expansion of 8t around yN,t- Recall the following differentiation formula 

d 



dx 



logdet^(2;) = tv A'{x)A~^(x). 



A direct application of this formula, together with the mere definition of yjv,t yields 



Hence, the Taylor expansion writes: 

mt{yN^t)^mt{yN,t) 



-1— [yN.t) = 
ay 



N : —\yN,t) 



2 dy2 

where £^N,t lies between yN,t and yN,t- The definition (fTTT i of yN,t yields 

M-N . , M-N 

< yN,t < 1 + 



.r {yN,t - yN,t) d'^St ,^ ^ 



dy^ 



M 



M 



(13) 
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In particular, y^r j uniformly belongs to a fixed compact interval, and so does yjv,t for similar reasons. One can 
easily prove that the second and third derivatives of 3t{y) are uniformly bounded on the union of these intervals. 
This result combined with the fact that NE{yN^t — yN,tf' — 0{M^^) implies that the last two terms in the right 
hand side (rh.s.) of (fljl i converge to zero in probability. By Slutsky's lemma I^J, it suffices to establish the CLT 
for N3{yN,t) instead of N3{yN,t) = N3g- This is extremely helpful since unlike yN^t which is random, y^r t 
is deterministic. The result is thus obtained by applying Theorem |3] and noticing that K{yN,t) + 1 = Note 
that although being valid only for fixed y, Theorem |3] could be appUed by considering the slightly different model 
Ht = y/yW^^t- ■ 

V. Simulations 

In the simulations, we consider the case where a mobile terminal with = 4 antennas receives during a sensing 
period of T slots data stemming from an ng = 4 antenna secondary transmitter We also set the number of symbols 
for sensing per slot to M = 15. We assume that the communication link is degraded by both additive white 
Gaussian noise with covariance (t'^In and interference caused hy K = 8 mono-antenna users. Hence, this scenario 
follows the model described by ([T]i, where for each t, the vectors Gt.k, fc e {1, • • • ,8} respectively represent 
the channel from the interferers to the receiver, whereas Ht represent the channel with the transmitter. Denote 
by Bt = [Gt.i, • • • , Gt^s]- In the simulations, Ht and Bt are randomly chosen as Gaussian matrices and remain 
constant during the Monte Carlo averaging. To control the interference level, we scale the matrix Bj for each t so 
that the signal-to-interference ratio SIR be given by 

sitit — — „ „u — a. 
trBtBt" 

In a first experiment we set T = 10 and SNR = ^ = 10 dB and represent in Figure |2]the theoretical and empirical 
normalized mean square errors for the G-estimator with respect to the SIR given respectively by: 

MSEt. = ^ , 

MSF _ if iV^(Jb-J)^ 

i—1 

where Tq is the G-estimator at the i-th Monte Carlo iteration and P = 10 000 is the total number of iterations. We 

also display in the same graph the empirical normalized mean square error of the SE-estimator defined as 

p 

i ■ 

^t,cm 



=1 



i—1 

We observe that the G-estimator exhibits better performance for the whole SIR range. These results are somewhat 
in contradiction with the intuition that a low level of interference tends to have a small impact on the accuracy of 
the SE-estimator The reason is that the mutual information depends rather on the inverse of the covariance of the 
interference and noise signals BfB^ + ct^Iat, as 

logdet(HtHH + BtB^ + a^Ijv) - logdet(BtBH + a^Ij^) = logdet(HtHjH(BtB,^^ + a^lN)'^ + In)- 
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We study in a second experiment the effect of T when the SNR and the SIR are set respectively to 10 dB and —10 
dB. Figure [3] depicts the obtained resuhs. We observe that, since the SE-estimator is asymptotically biased, its mean 
square error does not significantly decrease with T and remains almost unchanged, whereas the G-estimator exhibits 
a low variance which drops linearly with T. Finally, to assess the Gaussian behavior of the proposed estimator, 
we represent in Figure |4] its corresponding histogram. We note a good fit between theoretical and empirical results 
although the system dimensions are small. 




4 5 6 7 
SIR in dB 



10 



Fig. 2. Empirical and theoretical variances with respect to the SIR. 




Fig. 3. Empirical and theoretical variances with respect to T. 
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Fig. 4. Histogram of 



{3g-3). 



VI. Conclusion 

In this paper, we have proposed a novel G-estimator for fast estimation of the MIMO mutual information in 
the presence of unknown interference in the case where the number of available observations is of the same order 
as the number of receive antennas. Based on large random matrix theory, we have proved that the G-estimator is 
asymptotically unbiased and consistent, and have studied its fluctuations. Numerical simulations have been provided 
and strongly support the accuracy of our results even for usual system dimensions. 
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Appendix A 
Proof of Lemma[T] 

Recall that if P is a probability distribution on R+, then the Stieltjes transform m(z) of P is defined as 

./B A — Z 



(14) 



For example, the Stieltjes transform to_i_YjY^' associated to the empirical distribution of the eigenvalues of the 
Hermitian matrix -JjYtY[' is simply the normalized trace of the associated resolvent; 



, s 1 V- 1 1 / 1 , 

2—1 



Y,Y," - zl 



N 



where Ai, • • • , Xn denotes the eigenvalues of jjYtY^. Since their introduction by Marcenko and Pastur in their 
seminal paper [IS], Stieltjes transforms have proved to be a highly efficient tool to study the spectrum of large 
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random matrices. From an estimation point of view, Stieltjes transform are, in the large dimension regime of interest, 
consistent estimates of well-identified deterministic quantities. Therefore, the approach below consists in expressing 
the parameters of interest as functions of the Stieltjes transform of the eigenvalue distribution of jjYtY\^. 

Using the same eigenvalue decomposition as in Appendix IbI we can prove that Y( — UjDj^Wf where Wt is 
an iV X M standard Gaussian matrix, and where Dt is a diagonal matrix with the same eigenvalues as GtG^. 
In the sequel, if A is a p x p hermitian matrix, denote by the empirical distribution of its eigenvalues, i.e. 
= i X^iLi ^Ai(A)^ by the associated Stieltjes transform. 

Notice that due to Assumption IA3I the following decomposition holds true: 

GtG^ = tr^I^v + Tt, 

where Tt is a positive semi-definite matrix (simply write GjG^ = (j'^In + Ut(Dt — ct^Iat)!!^). 

Notice that Tn-£,^{z) = mTt{z — a'^). Using this fact, and the result in |fT6l Theorem 1.1], one can easily prove 



that m 1 satisfies: 



VzeC\R+, mj_^HY {^-)-m{z) — — — ^0 

* ' M.N.n^oo 



where rn{z) is the unique Stieltjes transform of a probability distribution F_, solution of the following functional 
equation: 

m(z)=(-z+^[ , A F^H\y\ . (15) 

Moreover, m{z^ is analytical on = {z e 0,3(2) > 0} where ^(z) stands for the imaginary part of z e C. 
Using ( fTSl ), one can prove that (z) satisfies: 

/I 2\ / X/ 1, N 

"^r. (^-^-'T j =m(z)(l-— )-— zm (z) . (16) 

The hnk between the unobservable Stieltjes transform niTt and the deterministic equivalent m(z) being established, 
it remains to express N^^ logdct(lAr + a^'^Vt) in terms of mpt, which follows easily by differentiation: 



5cr2 N 

Hence: 



1 / r 

-l0gdet[lAr + -| 



) = — tr 1 




r+°° 1 


1 




" N 




1 


/*-- 

Jo 


V 



2 



(17) 



We shall now perform a change of variables within the integral in order to substitute m for with the help of 
(fTST l. Since the support of F_ is on [0,+oo[, the Stieltjes transform m is continuous and increasing on ]— oo,0[. 
It establishes then a bijection from ]— oo,0[ to ]\im.j.,^^c<:,m{x),\imx^om(x)[. Obviously, \imx^-ooIR{x) — 
whereas lima;_j.o- m{x) — — oo since is an eigenvalue of -p-YtYj^ with multiplicity at least equal to M — A^. 
We have thus, 

1 



u i-> I — -— + a 

■mju] 
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establishes a bijection from Ml to (0, l/c^). Considering the change of variable j = + cr^, ( fTTI i writes: 



1 / r 

-logdet(l^ + -| 



-oo 




m(u) 



m'(u) 



rn{u) \ m(u) 

— , w~ o — T-T^ - 1 ~ ^ ' ^ u m'(u) 



(1 + (T^m(it))^ 
du 



du 



Mm'{u) a^m'iu) 



M 
TV 



urn'{u) 



N rniu) 1 + (7^m(u 

n the 

Mrn'(u) a'^m' ju] 



du. 



We shall now compute this integral, denoted by / in the sequel. Write / = limj;^-oo Ix,y where 



Straightforward computations yield: 

(m(y))^ 



Ix,y = log 



1 + cr^m(v) 



log 



N rn{u) 1 + a'^m(u) 
(m(x))^ 



M 

'n 



urn'{u) 



du 



1 + (T^m(x) 



M M fy M 

-j;^Vm.{y) - -^a;m(x) - / —rn{u)du 



(18) 



As our objective is to compute the limit of I^^y as a; — —oo and y — > 0, we need to obtain equivalents for rri at 
and —oo. A direct application of the dominated convergence theorem yields: 



m(x) 



1 



Recall that F_ is the probability distribution associated to m. Then, £({0}) = M~^{M — N). Although this property 

is not easy to write down properly, it is quite intuitive if one sees F_ a.s. close to F^* ^' (the empirical distribution 

of the eigenvalues of Yj^Yt) which clearly satisfies F^t^*{{0}) = M^^{M — N) by Assumption IA2I This 

assumption implies in fact that zero is an eigenvalue of Yj^Yj of order M — N . Hence, 

M-N 

miy) ^ — . 

— y^o My 

Using these relations, we can derive equivalents for the first four terms in the right-hand side of (fT¥t . In particular, 
we obtain: 



log 
log 



{m.{y)Y- 



1 + (7^m(y) 
(m(x))"« 



M 

TV 



1 loe 



M-N 
M 



- log(a2 



1 - ]y Hog \y\ 



1 + (7^m(x) 
M 

M 

X mix) 

N ' 



M 

x^ — oo ]\[ 



\og\x\ , 



'M_ 

y^O V N 

M 



(19) 

(20) 

(21) 
(22) 



Let us now handle the last term in ( fTsT l. Clearly, we have: 

F^^t^'{dx) = J^P" ' 



[M - N) 
M 



5o{dx) 
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which implies that 

, . M , . {M-N)l 

The above relations can be also transferred to the limit Stieltjes transforms m and m and their associated probability 
distribution functions F and F. Actually, we have: 

F{dx) = i^L^6o{dx) + ^Fidx) . 



and also: 



, , M . . {M~N)l 
m{z) = —m{z) + 



N—' ' N z 

Note in particular that jtiy^y^ — m — > 0, hence that F is a deterministic approximation of F^^^^" , the empmcal 
distribution of the eigenvalues of jjY{Y^. Now, 

m{u)du ~ f f — — ■ du , 



N—^' L t-u Nu 



f M ~ N 

= y (-log|i-y|+log|i-x|)dF(t) + ^^(log|x|-log|y|) . (23) 

Using the dominated convergence theorem, one can prove that the rh.s. of ( |23] | is equivalent to: 

n M r M M - N 

/ -^rn{u)du ^ - / \ogit)dF{t) + — log |.t| — log \y\ . (24) 



Plugging (dUl, (Eoll, (EB, (|22]| and da! into (dH) yields: 



M-N fM-N\ . /■ 



Since the spectrum of j^YtY^ is almost surely eventually bounded away from zero and upper-bounded IfTTl , 
uniformly along A^, we have: 



- 5]log(A,:) - j \og{t)dF[t) ~ > 



M,N.n^+oo 



where (A^, 1 < z < iV) are the eigenvalues of -^YfY^. A consistent estimator of logdet(GtG^) is thus given 
by: 

N 



h = 



M~N ^ fM^N\ ^ 1 , 



N ^\ M N ■ 



M-iV, M-N\ 1, , /I ,,h\ 
bg + 1 + — bgdct — YfY" , 



which concludes the proof. 
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Appendix B 
Proof of lemma[2] 

Define for p > 0: 

9t{p.y) = ^logdet(^pI^ + 2/HtH," + ^Y*Yr 

i_ 

Recall that Yt = GtWj. Denote by Gf = UjDj^V^ the singular value decomposition of Gt, Dt being the 
diagonal matrix of eigenvalues of GtG^\ in particular, Di's entries are nonnegative and bounded away from zero. 
Let Wt = Vj^Wt. Since the entries of Wt are i.i.d. and Gaussian, has the same entry distribution as Zj. 
Hence gt{p,y) becomes: 



= ^ logdet (^plj, + yV^UtU^lJt + j^D^WtW^nf 

Obviously, we have — logdet(Qt(y)) — gt{0,y) and j^trQt(y) = -p. tr Qt(0, y). Deterministic equivalents for 
gt {p, y) and Qt (p, y) have been derived in [11] and are recalled in the lemma below. 

Lemma 4 (cf. [iTj): Let p > 0. 

1) Let y > 0. The following functional equation: 

G*G," 



2/) = ^ tr (GtG"^ (^plN + + - 



+ Kt{p, y) 

admits a unique positive solution Kt{p,y). 
2) Define 

Tt(p,y)= (plN + yHtU'^ + j 



G.Gr 



+ Kt{p,y), 

Then, for any sequence of deterministic matrices Sn G C^^^ with uniformly bounded spectral norm: 

l-trSNQt{p,y)- ^trSr,Tt{p,y) > 0. 

iVl IVl M,iV,n— >oo 

In particular, setting Sat — GtG^, we get: 



-i-trGiG,HQi(p,y)~«t(p,2/) 



M t \r a, \r J M,N,n- 

3) Let 



-> 



Vt{p,y) = logdet (plN + yHtli^ + + M\og{l + Kt{p, y)) - M ^'^^f 

V ^ + Kt{p,y)J l + Kt{p,y) 



then 

ff(p,2/) - ^Vt{p,y) > . 
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The general idea of the proof of Lemma |2] is to transfer these deterministic equivalents to the case p \ 0; we 
will proceed by taking advantage from the fact that all the diagonal elements of Dt are positive and uniformly 
bounded away from zero. 

We first prove the existence and uniqueness of Kt{y). Consider the function / defined on [0, oo[ by: 

1 



f : X 1-^ X 

An easy computation yields the derivative of / with respect to x 



which is obviously always positive. Function / is thus always increasing and thus establishes a bijection from 
[0, oo[ to [/(0),+oo[. Since /(O) is negative, we conclude that / has a single zero. This proves the existence and 
uniqueness of It remains to extend the asymptotic convergence results to the case p — 0. 

In the sequel, we only prove item 2) for Sn = GtG\^ as it captures the key arguments of the proof; the extension 
to general sequences (Sat) will then be straightforward. Write tr GfGj^Qf (y) — Kt{y) as: 

j-tiGtG^QM-^^tiy) = j^tTGtG^Qt{y)-j^tTG,G^Q,ie,y) 

+ ^trGtG,"Qt(e,2/)-Kt(e,y) 

+ Kt(e,?/) - Kt{y) , 

where e > 0. We now handle sequentially each of the differences of the rh.s. of the previous decomposition. We 
first prove that there exists a fixed constant > (which only depends on limsup A^Af such that for every 
e > 0, there exists A^i (which depends on the realization and hence is random) such that for every N > Ni, we 
have: 



^ tr GtG^ Qt {y) - ^ tr G* G,^^ Q* (e, y) 



< 



K 



(25) 



To prove this, we rely on the resolvent identity B ^ — C ^ 
invertible matrices B and C. Then, we have: 



1 



tr GtG,"Qt [y) - — tr G^G.^Qt (e, y) 



M 



M 



-B ^(B — C)C ^ which holds for any square 



trGtG,HQt(0,y)Qt(e,y) 



<^trG.Gr 



M * * 



Recall that Wt is an iV x M matrix and that by Assumption |A2 limsupjyj jy NM ^ < 1. Therefore the spectrum 
of WfWj^ is almost surely eventually bounded away from zercj^. In particular, there exists a constant K such that 



eventually, we have 



WW^D; 



< K- 



hence: 



3Ni, VN > Ni, 



^ tr GtG^ Qt{y) - ^ tr G^G^Qtle, y) 



< 



K 



^Recall that if liraNM ^ = c < 1, then the smallest eigenvalue Anjin(WtW^) converges to (1 ~ V^)^ > it remains to argue on 
subsequences to conclude in the case where limsupjj^ jy NM~^ < 1 . 
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The second step consists in proving that for some constant K (depending on limsupA^Af ^) there exists N2 
(depending on the reahzation) such that for all N > N2: 



\Kt{e,y) - Kt{y)\ < Ke . 
The proof of ( l28T l relies on the following identity: 

Kt{y) - Kt(e, y) = £OiN + Pn {i^t{y) - Kt{e, y)) , 



(26) 



(27) 



where 



aN = jjtTGtG^Ttie,y)Ttiy) , 

. f GtG^Ttie,y)GtG^Ttiy) 

M '\ {l + Kt{y)){l + Kt{e,y)) 



It is clear that /3jv < liminf Thus, by Assumption IA2I /J^r < 1. Also, one can prove that there exists K > Q 
such that limsupaAT < K. In fact, satisfies: 



N 



(GtG,") {l + Kt{y)){l + Kt{e,y)) . 
One can prove that Kt{y) and Kt{€,y) are smaller than mci^ /m) ■ ^'^ '^t{y) can be written as: 



(28) 



>it{y) 



tr h/HtH^ fyH,HH + - 



< 



Njl + Ktjy)) jl + Ktiy)) 
M M 

N 



i^t{y) 



i + Kt(y) 



Similar arguments hold for Kt{e,y), thus proving that limsupaAr < K. From dZTl l. we conclude that there exists 
N3 such that for all N > N3, 

\Kt{e,y) - Kt{y)\ < Ke . 

We are now in position to prove the almost sure convergence of jj tr GtG^Qt{y) — nt{y)- Consider the constants 
K and K as defined previously and let e > 0. According to dZSl l. there exists A^i such that: 

e 



ViV > iVi 



^ tr CG^Q, (y) - 1: tr G^G^Q, (e, y) 



< 



K 



Using the almost sure convergence result of tr GtG^Qt(e, y) stated in Lemma|4] there exists A'2 such that: 

VA^>iV2, ^trGtG,"Qt(e,2/)-ACt(e,y) <e. 
Finally from ( |26] |. there exists Nj, such that for all N > N^: 

\Kt{e,y) - Kt{y)\ < Ke . 
Combining aU these results, we have, for N > max(iVi, iV2, N3): 



l-trGtG'^Q(y)-Kt{y) 



<e{^ + l + K 
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hence proving that: 

l-trGtG^Qtiy) - Kt{y) > , 

which is the desired result. 



Appendix C 
Proof of Theorem[2] 

As previously mentionned, the proof of Theorem |2] relies on the existence of a consistent estimate for 



Ji,i = ^logdet(GtGH+HtH,H) 



Denote by /(y) the parametrized quantity: 



f{y) = 1 logdet(YtYr + yUtU^) 



Then by Lemma |2l-3), we obtain: 

-m + ^ logdet (-5^ + yU,H^) + | log(l + .M) - ^TT^ 77V^ ' ' (^9) 

A* \1 + Kt{v) IN N 1 + Ktlv) M,N,n^Qo 



Kt{y) ^ ^ A^ Nl + Kt{y) M,N,n^oo 

Obviously, if y is replaced by yN,t, a solution of: 

VN.t = — — T , (30) 

1 + Kt(yN,t) 

then the term Ct i appears in ( |29] l. The existence and uniqueness of yN,t immediately follows from the fact that 
the function g defined as: 

g:x^{l + x)j^tT{GtG^)iHtH^ + GtG^y' 

is a contraction. Moreover, straightforward computations yield: 

yN,t = 1 - ^trGtG.^HtH," + GtG,")-i . (31) 

Unfortunately, j/^r t depends on the unobservable matrix Gt. One needs therefore to provide a consistent estimate 
yN,t of yN,t- In order to proceed, we shall study the asymptotics of Kt{y). By Lemma|2l-2), we have: 

^trH,HrQt(2/) - ^trH,H»T,(y) > . (32) 

On the other hand, we have: 



A^ 1 



tr ( G.G^ ( yH.HH + 



M M{Kt{y) + l) y ^ ^ ^ ^ 1 + Kt(y) 
M 1 + Ktiy) ' 
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Substituting (|33] l into (|32] l. we obtain: 

— tryHtHt^Qtfy) - — + 1 "^^^^^ > . (34) 

Intuitively, a consistent estimate yN,t of ?/Ar^t should satisfy yN,t = M^^yjy^t tr HtH^Qt(yAr j) — ^ + 1. This 
intuition is confirmed by the following lemma: 

Lemma 5: There exists a unique positive solution ijN.t to the equation: 

Moreover, the following convergence holds true: 

VN.t - VN.t > , 

M,7V,n— >oo 

where y^v,* is defined by dSOl ) (see also dSTTl). 

Proof: The existence of yAr_( follows from the fact that: h : y ^ -|j tr HjH^Qf (y) — + l — yisa 
continuous function on [0,+oo[, satisfying h{Q) > and limy_j.+oo ^(y) = — oo. Assume that h admits more 
than one zero. It is clear that the zeros of h are isolated. Since h{0) > 0, there exists then yi and y2 such that 
h{yi) — h{y2) — and h{y) < for every y £ [yi,y2]- However, this could not happen since h is concave, and 
as such > l/2h{yi) + 1/2/1(2/2) — 0. Function h admits then a unique zero yN,t- 

Using (l34l i. we get that: 

^ tr H,HHQ,(2/^,) - ^ + 1 - yN^t > . 

M 1\1 M,N,n^oo 

Beware that in ( |34| |. the convergence holds true for a fixed y while yN.t depends upon N. A way to circumvent 
this issue is to merge y^^t into Hf and to consider the slightly different model based on Hi = ^i/jv^fHt. 
Therefore, the mere definition of j/at j and the previous convergence yield: 

HyN,t,yN,t) > 0, 



where 



k{yN,t,yN,t) = tr(HtHt^Qt(yAr,t)) - VNA + yN,t - '^j^ tr(HtHt^Qt(y7v,t))- 



Expanding k{yN,t,yN,t), we get: 

HyN,t, m^t) = ^ tr{ntn^qt{yN,t)) - ^ tr{HtU»qt{yN,t)) + ^ tr{UtU^Qt{yN,t)) + {yN,t - yN,t) 

~y^tT{UM^qt{yN,t)) 

= mAvN^t - yjv,*)-^ tr(HtHt"Qt(yAr,t)HtHi^Qt(?/jv,t)) + {yN,t ~ yN,t) 
+ im.t - yN,t)j^ tr{lltii]^QtiyN,t)) 

= {yN,t - yN,t) (i -j^trUtU^QtiyNA + ^tr{Htn^qt{yN,t)'^tn^Qt{yN,t))) 
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To conclude that yN,t — yN,t converges almost surely zero, one needs to estabslish that a deterministic asymptotic 
approximate of 

1 - ^trHtH,"Qt(y^,t) + ^tr(HiH,HQi(yjv,OHtH^Qt(yiv,t)) 

could not be equal to zero. This is true, since from the definition of yN,t, we can easily check that 1 — ]g tr HtH^Qt(2/jv_t) 
can be approximated asymptotically by 1 — j^^^^ ^ trHjH^ (HtHj^ + GtG^) ^, where we recall that y^^t writes 



as: 



The deterministic equivalent of 1 — -rr tr HtH5^Q((?/jv,t) is thus given by: 



1 - ^ 



l-^ + ^trH,HH(G,G,"+H,HH)-^ 
which is obviously uniformly lower-bounded by 1. ■ 
With the help of Lemma |5] the following convergence can be easily verified: 

K{yN,t) - n{yN.t) > . 

Let ft, : y i~> logdet(Qf(y)), where h'{y) = ^ tr(HtHt^Qt(2/)) < ^^^J|"'j|,^YH) ■ As the minimum eigenvalue 
of jg(YtY[') is almost surely bounded away zero, function h is Lipschitz. Therefore, the following convergence 
hold true: 

1 1 as 

— logdet(Qt(?/jv,t)) - ^ logdet(Qt(yAr,t)) — — > , 



We then get: 



-fim^t) + ^ logdet(GiG,H + HtH,H) - ^ \og{m,t) ~ ^(1 - yN,t) — > , 
which in turn implies that: 

Using this estimate of Jt,! together with the estimate of 3t^2 as provided in Lemma [T] immediately yields a consistent 
estimate for 3t(cr^) — 3t,i — Jt,2, and the theorem is proved. 

Appendix D 
Proof of theorem[3] 

The proof of Theorem |3] relies on the tools used in lfT2l . adapted for dealing with Gaussian random variables. 
Recall that JsEiy) is given by: 



JsE(y) j^rp 



l^logdet [yU.-n^ + ^Y,Yr) - logdet (^Y^Y^) , 
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where Yf = GjWf. Similarly, as in Appendix IB] and Appendix lAl we can prove that Yt = UjDj^ Wj where Wt 
is a X M standard Gaussian matrix, and Di is the N x N diagonal matrix containing the eigenvalues of GtG^. 
Then, Jse(2/) becomes: 

T 

t=i 

T 

t=i 



IN 



Denote by Dj ^ Uj^HtHj^UtDj = = VtAtV^ the eigenvalue decomposition of 'U^HtU^\Jt'D^ \ Since pt 
is the rank of H(Hj^, matrix At has exactly pt non zero entries which we denote by (A^^t, 1 < i < pt)- We get 
that jgE can be written as: 



Let Apj t = diag (Ai.t, . . . , Ap^.t). Obviously, only the diagonal elements of Ap^.t contribute in the expression of 
Jse(?/)- Then, using flSl Theorem 3.2.11], we can prove that !Jse(j/) can be written as: 

where Wp^ j is a x M — N + pt standard Gaussian matrix. Let M = i^^^-^^^t£ilAp^\, we finally get: 
JsE(y) = ^ E l«gdet ( ^,_^^^ MiWp,,WpH,Mi + Ip,) - log dot (M) - logdet ( ^^_^^^ W„ 



= 5I^Es,t(y)- 



t=i 



Let s = M — N + Pt. By Assumptions IA2I and IA51 1 ). we have: 

s s 
< liminf — < limsup — < +oo. 

M,N,nB-^co Pt M,N,no^oo Pt 

Moreover, Assumption IA4I and IA5I -2) implies that matrix M satisfies: 

sup ||M|| < oo and inf i trM > 0. 

N,M,n N,M,n s 

We retrieve then the same model as in lfT2l . with the slight difference that 3ES,t{y) has an extra random term 
logdet jgWpj (Wp^ As we will see next, this has no impact on the applicability of the method and one can 
get the desired result by following the same lines of |12|. For ease of notation, we will drop next the subscripts pt 
and t from all matrices. In particular, we consider to prove a CLT for the functional logdet(f M2 WW"M5 +1) - 
logdet(iM^WW^^M5) where p > 0, W is an X s standard Gaussian matrix and M is an pt x pt deterministic 
matrix. 

The expression of the variance for this CLT will depend on some deterministic quantities which we recall hereafter 
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A. Notations 

Let Z = M^W and define the resolvent matrix S(z) by: 



s(z) = (^M5ww"M3 + i) ^ = (^zz^^ + 1' 



Let also Is{z) be given by: 

Isiz) = logdet f-M^wW^Ms + l) = -logdctS(z). 



s 



We introduce the following intermediate quantities: 

11° 
I3{z) = -ti-MS, a(z) = -trMES, and 13^ /3 - a. 
s s 

Matrix Il{z) is an s x s diagonal matrix defined by: 

R(z) = fl., 

where f — Yqr^j(7y- We also define R(z) the pt x pt diagonal matrix given by: 

R(z) = (I + zrMy^ = diag(r„ l<i< pt), 

where ~ ^^^f^. ■ We also define 6{z) as the unique positive solution of the following equation: 

1 ^ 



<5(z) = -trM 1+— -— M 

s \ 1 + zo{z) 

where the existence and uniqueness of 5{z) have already been proven in lfT2l . Let H and S be the pt x pt and 
s X s diagonal matrices defined by: 

H = ( I + ^:r-^M^ and H ^ ' 



l + z5{z) J l + z5{z) 

Define also 7, ~5{z) and 7 as 7 = i tr M^H^, ~5{z) = j^^^ and 7 = j^^j^^^^- 

B. Mathematical tools 

We recall here the mathematical tools that will be used to establish theorem [3] All these results can be found in 

m. 



1) Differentiation formulas: 



_ ^ rs71 



aiogdet(iZZH) ^ r 
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2) Integration by parts formula for Gaussian functionals: Denote by $ be a 6^ complex function polynomially 
bounded with its derivatives, then 

"a$(z)" 



E[Z,,,$(Z)] =m,E 



dZ* 



where m, is the j-th diagonal element of M. 
3) Poincare-Nash inequality: The variance of $(Z) can be upper-bounded as: 



var($(Z)) < ^^m,E 



5$(Z) 



a$(z) 



dZ., 



4) Deterministic approximations of some functionals: 

Proposition 1: Let A and B be two sequences of respectively pt'xpt and sxs diagonal deterministic matrices 
with uniformly bounded spectral norm. Let Assumptions IAHIA4I hold true. Then, the following holds true: 



tr AR 



1 



trAH + (s" 



0(s"2) and tr AH = i tr AH + (s^^) 



Proposition 2: Let A, B and C be three sequences of pt x pt, s x s and pt x pt diagonal deterministic 
matrices whose spectral norm are uniformly bounded in pt- Consider the following: 



$(Z) = itr (aS?^ 



1 / 7TK7^ 
l'(Z) = - tr ASMS 



and assume that IAHlA4l hold true. Then, 

a) The following estimations hold true: var(<i>(Z)), var(5'(Z)), var(/3) are 

b) The following approximations hold true: 



E 



E[$(Z)] = 
]E[*(Z)] = 
trMSMS 



6-trAMa + 0(s- 
s 



(35) 



1 



1 — 2:^77 
7 



(5itrBitr(AM2H2) - z77itrBitr AMH ) + (s-^) , (36) 
s s s s I y ' 



1 — z"^77 



(37) 



C. Central limit theorem 

All the notations being defined, we are now in position to show the CLT. We recall that our objective is to 
study the fluctuations of Jse(2/) = Stli 3ES,t(2/)- Since ^//ES,t(2/), i = li • ' ' i are independent, it suffices to 
consider the CLT for JES.t(y)^ for t G {1, • • • ,T}. We consider thus the random quantity Is{z) — logdet (■i-ZZ'^). 
Before getting into the proof details, we shall first recall the CLT of .g(Z) = — logdet(iZZ'^) whose proof can be 
found in |fT9l . Indeed, it is shown that: 

— logdet fizz^) -b^ ? ^?i(0,l). 
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where b, = -pt (l - ^) log (l - ^) - 1 . Like in define ^'^(u,^) = E ^eMisiz)-v,{z)+g{z)-b,)^^ ^^^^^ 



Vs{z) is the deterministic equivalent defined by: 



Vs{z) = slog (1 + z(5(z)) + log det 1 + ftt^ - szS{z)6{z), 

' 1 + zo(z) ' 



and verifying: 



S M.N.n^oo 



> 0. 



The principle of the proof is to establish a differential equation verified by ^^(m, z). Writing the derivative of 
z) with respect to z, we get: 



dz 



dz 



Since ^^^^^^ — sSS |12|, we have: 



dz 



= E 



dz 



On the other hand, we have: 



E 



dlsjz) 
dz 



juIs{z)+]ug{Z) 





r /szz"\ 


= E 


K . ) 







dz 



Pt s 



Applying the integration by part formula, we get: 



E 



7 Z* 



= E 



dZ: 



■ E 

^E 
s 

JUZ 



[SZ1„ , m^S^.,Z:. ^e^^Is{z)+3ug{Z) 



'P,J 



E 



■E 



juIs{z)+jug[Z) 



After summing over index i, we obtain: 



(38) 



(39) 



E 



: E 

^E 
s 

JZU 

s 

juE 



7n pJ'^Is{z)+]ug{Z) 

II ipUp^pC 



tr(MS) [SZ]p_^. ^*^.eJ"-r»(^)+J"9(z) 



(40) 
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Recall the relation /3 = ^ tr MS and p= j3 - a where a = ^ tr MES. Plugging the relation j3 = a+ P into ( l40b . 
we get: 



[SZ]„ ^. Z* .eJ"-f-(^)+J"9(z) + [SMSZ]„ , Z* ^e3^iA-)+i^9iz) 



-juE 



SM(ZZ^^) ^Z 



(41) 



Hence, solving this equation with respect to E [SZJ^^ ^* ^.gj"J42)+Jt'5(z) ^jj^j using the fact that 7~ = TTza' we 
get: 

[SZ]„ ., Z* ^e3"iAz)+jua(z)] ^ ^ \mprSp„e'"^'^'^+^'^^^^A ~ zE 13 f [SZ]„ , Z* ^e^^is{z)+3ug{z) 



s 

-jul 



jur[ 



SMfZZ^) Z ^* .gju/,(2)+j«s(z) 



pj 



(42) 



Using the relation S'p.p — 1 — ^ [SZZ'^]^^, we get after summing with respect to j, 
"SZZ'^l 



E 







"szz"" 


— zrupf 










s 



juIs(z)+jug(Z) 



o 


'SZZ"' 








s 



-juE 

Using the relation r„ = -rr^ — , we have 
"SZZ'^i 





SM" 


f 






s 



^]uh(z)+jug(Z) 

P,P 

juI^{z)+]ug{Z) 



JUZ 



E 



SMS- 



.ZZ^^ 



iu7s(z)+jug(Z) 



E 



]iiIs{z)+]ug{Z) 



= E 



P rrp 



szz 



HI 



juI^{z)+]ug{Z) 



JUZ 



E 





r ZZH] 


rrp 


SMS 


s 



iuI,(z)+jug{Z) 







SM" 


~juE 


rrp 






s 



juIs{z)+]ug(Z) 



Summing over p, we finally obtain: 
^SZZ'^ 



E 



tr 



pJuIs{z)+JiLg{Z) 



f tr(MR)E 



juh{z)+]ug{Z) 



- zE 



P f tr RS 



.ZZ^^ 



juIs{z)+]ug{Z) 



+ -juE 

S 

— jufE 



tr RSMS 



zzi- 



pJuIs{z)+]ug{Z) 



tr 



juI,{z)+]ug{Z) 



= Xl +X2 +X3 +X4- 

It remains thus to deal with the terms {xi, 1 < « < 4). Using proposition [T] we have: 



Xi = r tr MRE 



^]uIs{z)+]ug{Z) 



= s66E 



^juI^{z)+]ug{Z} 



(43) 
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To deal with xa, we apply the results of proposition |2}b, with A = R and B = I. In this case, X'i writes as 
X3 = zjufE\l/(Z)e-'"^=^^)+^"^^'^\ Using Cauchy-Schwartz inequality, we get: 



E 



{Z)e^'^^^^^'^^^'^^^'^'^^ - Ee^"-'^=(^^+-'"3(^^E (*(Z)) 



< 



*(Z) 



where * (Z) = «'(Z) - E(*(Z)). Therefore, 



X3 



z]u5 
1 — 2^77 



^1 



,5- tr(M2H3) - fUtrMH 



E 







The term X2 can be dealt with in the same way, thus proving: 



X2 = -zE 



P e 



]uIs{z)+jug{Z) 



7tr(MH2) + 0(s-i) 



Since tr{MS?) is of order s, we shall expand E /3 eJ"^=^(^)+J"s(^) 
E |^gj«-fs(2)+j"s(z)j cannot be separated in the same way as above. 
Indeed, we shall first take the sum over j in ( l42b . thus yielding: 



(44) 



(45) 



to at least the order s ^, and thus /3 and 



E 



[SZZ^]ppeJ"-f=(^)+^"s(^'j =E [smpfS-p^pg^^^^^^^+^^s^^'j - zE /3 f [SZZi^] ^ ^ e^"^»(^)+J"9(^) 



-E 



(46) 



Using the fact that: 



-E 



C p3^l!,iz)+Jug(Z) 



Eq. ( |46] | becomes: 



E 



^]uh{z)+]ug{Z) 



E 



C p3^Is{z)+Jug{Z) 



zE 



z^E 



/3 f 



szz^- 



iu/s(z)+j«g(Z) 







\ ZZH] 


+ — E 


jur 


SMS 


s 


s 



]uIsiz)+]ug{Z) 



JUZ 



E 



' [SM] e^«-fs(2)+J«s(z) 
(47) 



Solving E [S'p^pe^^-^^t^'+^^f'^)] in (|43 and using the relation rp = y+^^t^t, we obtain: 



E 



C ]uIs{z)+jug{Z) 



E 
s 



i«/,(z)+j«3(Z) 



-E 



P Tpf [SZZ'^]^^e^"-f=(^)+^"f(^) 





\ ZZ"1 


jufrp 


SMS 

s 







juIsiz)+]ug{Z) 



S 



]uIs{z)+jug{Z) 



(48) 



Multiplying both sides in ( |48] ) by rup and summing over p, we get: 



E 



/3 e 



juIs(z)+]ug(Z) 



= E 



- tr(MR - MES)eJ"^='(^)+J"»(^) 
s 



-E 



— E 

s 



1 77*^ 
juf- tr(MRSMS yui,{z)+3ug(z) 

s s 



13 -tr(MRSZZ'')e 

s 



JUZ 



H-]pJuIs{z)+jug{Z) 

tr(MRMS)eJ"-^»(^)+^"s(^' 
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Using the approximating expressions in proposition |2] we obtain: 



13 e 



Hence, 



j«/s(2)+jug(Z) 



13 e 



]uIi,{z)+jug{Z) 



s(l — Z^77) \ S 



6-tT(M^a^) - 27^7 



tr(MRSM)e- 



+ 0(s-2). 



E 



(3 e 



^]uh{z)+jug(Z) 



+ 



juzSj 



^juIs{z)+]ug{Z) 



s(l — Z^77) 

Plugging ( l49b into (|45] |. the term X2 can be written as 



X2 



s(l — 2^77)2 
juz'^jS^ 1 



7- tr(M3H3) - 27^,5^ ) tr(MH2)E 



tr (MH^) 



juIs{z)+]ug{Z) 



^]uh(z)+jug(Z) 



(1 — 2^77) S 

Finally, it remains to deal with Xi- Using proposition [T] we get 

ju5 



X4 



■tr MH^ 



]uIs[z)+]ug(Z) 



(49) 

(50) 
(51) 

(52) 



Summing (|43] l. (|44] |. (ISTT i and ( |52] l. we obtain after some calculations: 



E 



tr 



mIs(z)+]ug(Z) 



Z^JU^^ 1 



s66 



s(l — 2^77)^ 



tr (M^H^) tr (MH^) + , 1 tr(M^B3) 

1 — z"^77 s 



(1 — 2^77)^ s 



1 — 2"^77 s 



juIs{z) + 'jug{Z) 



+ o(.-). 

(53) 



Hence the differential of '^s{utz) with respect to 2 satisfies: 



dz 



, "'f^' i tr (M^H^) - tr (MH^) - ^ ^ 1 tr (M^H^) 

(1 - 2277)2 s ' s ^ (1 - z^ll) s ^ ' 



L^Z^-i8'' 1 



U^S 1 



(1 — z2--)/^)2 g 

Following the same lines as in IIT2II . one can prove that 

1 rflog (1 - 2277) 1 / 227(5^1 tr (MH^ 



tr (M5^) + ^ " " , -tr (MH^) 

1 — 2^77 s 



dz 



1 — 2277 



1 — 2^77 



27^ tr (M^H^) + - 

s 



*,(m,2) + 0(s-1). 

3721 tr (M3h3) itr (MH2 



1 — 2277 



Moreover, from the system of equations (51) in 112], one can find that: 

Id log 7 l\iT{MB?-) 



2 dz 



Using (l54b and (ISSt . we finally get: 



dz 



u 



1 — 2277 

d log 7 



(54) 



(55) 



log(l-2277) + 
dz dz 



*,(U,2) + 0(S-1) 
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Let (7^ — ^ log (l — 2^77) + log7 and Ks{u, z) = z) exp ^ " . Therefore, Ks{u, z) satisfies: 

— =e(.,z)exp(^— 

where it can be proven that |e(s, z)| < f , for every s in [O,/?]. On the other hand, we have: 

if,(u,0) =E fe^"(-^°sdct(izzH-6.))- _ 

Hence, 

= i^s(M,0) + /" es{u,x)dx 
Jo 

= e 5 + (s-^) . 

The characteristic function ^s{u, p) can be thus approximated as: 

vl/,(u,p)==exp + ±l)+0{s-^). (56) 



2 2 ^ 

The characteristic function satisfies the same equation as in lfT2l . The single difference is that the variance aN,t{y) 
given by: 

a^Ay) = - log [^-^) - log(l - 7) (57) 

has two additive terms accounting for the variance of g{Z) and the correlation between g(Z) and Is{z)- The CLT 
can be thus established by using the same arguments in lfT2l . provided that we show that lim inf t (y) > 0. For 
that, we need only to prove that: 

liminf > 0. 

s,pt 7 

Deriving 6 with respect to z, one can easily see that: 

1 — z^77 1 1 



dz 

It has been shown in lfT2l eq.(67)] that — ^ satisfies: 



tr (MH^) 



az s 

where Amax = max (Ai_t, • • • , Ap^^t). This fact combined with liminf i tr (MH^) > implies that liminf Q;Ar,t(?;) > 
0. It remains thus to express the variance a^.tiv) using the original notations. One can easily show that: 

. = 1 tr f ^Dr%rH.HHu.DP + ^ - ^ " + 

s \ s 1 + 5 J 



s 

{N~pt)[l + 5) 
s 



M y ^ ^' y ^ M{1 + 5) 



Januaiy 25, 2013 



DRAFT 



32 



Then, from 



we can prove that ^'^^^^^'l — 1 is solution in x of: 



1 



Since Kt is the unique solution of ( l59l l. we have: 

M{S+1) ^ 
1 = 



GtGt 



(59) 



or equivalently: 



Therefore: 



1 



M 



7 



1 + S s{Kt + 1) 



In the same way, one can prove that 7 can be expressed in terms of the original notations as: 

In K + l)2s(iV-pt) 



Substituting i6l\ and ( I6OI 1 into (l57] l. aN,t{y) becomes 



Kf + 1 



M2 



"TV,* 



(y) = logM^ - log ( (M - TV) ( M{^t + l)^ - tr (ylltll" (GtG,^) ' 



I 



AT 



Kt + 1 



(60) 



(61) 



Appendix E 

Proof of theorem[3] 

1) Denote by R{y) and f{y) the functionals given by: 

1 u M - N 

f{y) = -tr{yU,U»QM) + -j^ 



where Qt(zj) = iyHtH.^ 



R{y) = - log det(Qt(y)) + (M - N) log(y) - My. 
-p-YfYf^) ^. According to Poincare-Nash inequality, we have: 



N M 

1=1 j=i 



E 



ay. 



N,t 



■E 



(62) 



We only deal with the first sum in the previous inequaUty; the second one can be handled similarly. By the implicit 



function theorem, if ^ 7^ then -^y 



dj/N.i 



writes: 



df 



i.yN,t) 



dyN.t 

As will be shown later, to conclude that var(yjv t) — 0{M^'^), we need to establish that ^ijjN.t) 
bounded away from zero, which is a much stronger requirement than ^ ^ 0. This can be proved by noticing that 



(63) 



is lower 



|R ^ M/. Hence 

oy V 



-{yN,t) = 



dy^ 



yN,t 



(64) 
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On the other hand, one can prove by straightforward calculations that 
(|64] |. yields: 



-op-[yN,t) 



> 



M-N 
Vl,t 



df 



dy 



> 



M-N 



which, plugged into 



(65) 



MyN^t 

which is eventually uniformily lower bounded away from due to Assumption IA2I and to the fact that yN,t < 1 
by mere definition. Therefore, 



N M 
i=l 3 = 1 



dyN,t 



dY* 



N M 



M4 



=1 J=l 



K ( YY* 



< 



K 

M2 



To prove 2), we rely on the resolvent identity which states: 

Qt(a) - Qt(6) = (6 - a)Qt(a)HtH,^Qt(&) . 

Using ( |66l ), we obtain: 

VN,t = ^{VNA - EyAr^t)trHtHHQt(i/^_t) + ^ trE(i/^v,t)HtHj^Qt(yw,t) + ^'^ ^ , 

-^iyN,t - EyAr^t)HtH,"Qt(Eyw,t) - -J- tr(yjv,t - Eyw,t)'HtH,^'Qt(yjv,t)HtH^Qt(Eyjv,* 



(66) 



M 



M 



-i- trE(^jv.OHtH,HQt(Eyw,0 - 1?7 trE(yAr,t)(y^,t ~ E(yjv,t))HtH^^ 



M 

(a) 1 



M 



M - 
M 



iyjv,t)trHtH,HT(E(yjv,t)) + ^E(yAr,t)HtH,"T(E(yjv,t)) 



MyN,t){yN.t - EyAr,t)E 



M 



trHtH,HQt(yAr,t)HtHHQ,(E(yAr,t)) 



M 



where e satisfies E(e) = 0{M ^). Note that equality (a) follows from the fact that 

var(yjv,t) - (-^ and var ('^ tr HtH,HQt(yw,t)HtH,"Qt(E(yw,t)) 



Both estimates can be established with the help of Poincare-Nash inequality. Therefore: 

1 u M-N 

nyN,t) = — ^(yJv,t)trHtH,HTt(E(yA,,t)) 

1 



M 

= 1 - 



A/ 



M(l + K(E(yN,t)) 
««(E(yAr.O) 



tr((GtG,^)Tt(E(y^,0)) + 0(M-2) 



1 + n{^{yN,t)) 
1 



l + Kt(E(yAr^f)) 

Using the mere definition of yyv.t and ( |67T i, we obtain: 



(67) 



1 + K(E(yiv,t)) 1 + K(yw,t) 

niyN,t) - K(E{yN,t)) 
(H-K(E(yA,,0))(l + «(yjv,t)) 



0(M-2) 



(68) 
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Following the same lines as in Appendix |Bl we can prove that for every real postives yi and y2, we have: 

Kt(yi) ~ i^t{y2) = (2/2 - yi)aAr,t(yi, 2/2) + {utijji) - Kt{y2))i3N,t{yi,y2) 

where aN,t{yi,y2) and ^jv,t(2/i, 1/2) are given by: 

aNAyi.y2) = ^trGtG,"T(y2)HtHHT(yi), 
~ 1 GiGHT(j;2)GiGHT(yi) 

PNAyi^y2) = T7^^- 



M (l + Ki(yi))(l + «t(y2)) 
Kt(yi) - Kt{y2) 



Moreover, we can easily notice that /^Ar^t < liniinf ^ < 1. This allows us to express Kt{yi) — nt{y2) as: 

ajv^t (2/1,2/2) (2/2 " 2/1 ) 

1 - ^N^yi^y^) 

Using this relation, we obtain from (|68^ : 

Elyw,*) - yN,t = iN.t{^yN,t - yN^t) + o(m-^) 

where 

aN.tiyN,t,^yN.t) 

iN.t — = '■ '■ 

(1 - l3N.tiyN,t,yN,t)){l + Kt{EyN,t))il + K{yN,t)) 
To conclude, we shall establish that limsup7Ar ( < 1. This is true, since using the relation y^ t = (1 + '^(2/iv.t))^^' 
we prove after some calculations that: 

Cat,* 

iN.t - 



1-d 



where 



CN t = TT trfHtHt^ + GtGt^)-iHtH"T(E(i/7v t))GtGt^ 

'^^^^ = TTTT— W^-^t^(H*HiVGiGH)-iG,GHT(E(yA.,,))GtGr 



Since c^^t + dN,t < ^, and (Ipj^t < 17 



1 - dN,t ^ 1 - dN,t ~ l-4r 



which implies that: 



lim sup — < 1 . 
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